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Introduction 


These notes constitute a survey of the theory and practice of inequalities. While their 
intended audience is high-school students, primarily present and aspiring participants of the 
Math Olympiad Program (MOP), I hope they prove informative to a wider audience. In 
particular, those who experience inequalities via the Putnam competition, or via problem 
columns in such journals as Crux Mathematicorum or the American Mathematical Monthly, 
should find some benefit. 

Having named high-school students as my target audience, I must now turn around and 
admit that I have not made any effort to keep calculus out of the exposition, for several 
reasons. First, in certain places, rewriting to avoid calculus would make the exposition a 
lot more awkward. Second, the calculus I invoke is for the most part pretty basic, mostly 
properties of the first and second derivative. Finally, it is my experience that many Olympiad 
participants have studied calculus anyway. In any case, I have clearly flagged uses of calculus 
in the text, and I’ve included a crash course in calculus (Chapter 4) to fill in the details. 

By no means is this primer a substitute for an honest treatise on inequalities, such as 
the magnum opus of Hardy, Littlewood and Polya [2] or its latter-day sequel [1], nor for a 
comprehensive catalog of problems in the area, for which we have Stanley Rabinowitz’ series 
[4]. My aim, rather than to provide complete information, is to whet the reader’s appetite 
for this beautiful and boundless subject. 

Also note that I have given geometric inequalities short shrift, except to the extent that 
they can be written in an algebraic or trigonometric form. ADD REFERENCE. 

Thanks to Paul Zeitz for his MOP 1995 notes, upon which these notes are ultimately 
based. (In particular, they are my source for symmetric sum notation.) Thanks also to the 
participants of the 1998 and 1999 MOPs for working through preliminary versions of these 
notes. 


Caveat solver! 


It seems easier to fool oneself by constructing a false proof of an inequality than of any other 
type of mathematical assertion. All it takes is one reversed inequality to turn an apparently 
correct proof into a wreck. The adage “if it seems too good to be true, it probably is” applies 
in full force. 

To impress the gravity of this point upon the reader, we provide a little exercise in 


mathematical proofreading. Of the following X proofs, only Y are correct. Can you spot the 
fakes? 
PUT IN THE EXAMPLES. 


Chapter 1 


Separable inequalities 


This chapter covers what I call “separable” inequalities, those which can be put in the form 


f(ti) +++++ flan) 2 ¢ 


for suitably constrained 71,...,2%,. For example, if one fixes the product, or the sum, of the 
variables, the AM-GM inequality takes this form, and in fact this will be our first example. 


1.1 Smoothing, convexity and Jensen’s inequality 


The “smoothing principle” states that if you have a quantity of the form f(21)+--:+ f(@n) 
which becomes smaller as you move two of the variables closer together (while preserving 
some constraint, e.g. the sum of the variables), then the quantity is minimized by making the 
variables all equal. This remark is best illustrated with an example: the famous arithmetic 
mean and geometric mean (AM-GM) inequality. 


Theorem 1 (AM-GM). Let 21,...,2%n be positive real numbers. Then 


Lisp ele 
n 


es VU1tt Dn, 


with equality if and only if 7) =--+- =p. 


Proof. We will make a series of substitutions that preserve the left-hand side while strictly 
increasing the right-hand side. At the end, the x; will all be equal and the left-hand side 
will equal the right-hand side; the desired inequality will follow at once. (Make sure that 
you understand this reasoning before proceeding! ) 

If the x; are not already all equal to their arithmetic mean, which we call a for conve- 
nience, then there must exist two indices, say i and j, such that x; <a < aj. (If the x; were 
all bigger than a, then so would be their arithmetic mean, which is impossible; similarly if 
they were all smaller than a.) We will replace the pair x; and x, by 


/ ! . 
Uj, = 4,0; = UTX; — a; 
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by design, x; and x, have the same sum as x; and z;, but since they are closer together, 
their product is larger. To be precise, 


eee, = 6) wat ee = ONG a) > aaa; 


because x; — a and a — a; are positive numbers. 

By this replacement, we increase the number of the x; which are equal to a, preserving the 
left-hand side of the desired inequality by increasing the right-hand side. As noted initially, 
eventually this process ends when all of the x; are equal to a, and the inequality becomes 
equality in that case. It follows that in all other cases, the inequality holds strictly. O 


Note that we made sure that the replacement procedure terminates in a finite number of 
steps. If we had proceeded more naively, replacing a pair of x; by their arithmetic meaon, we 
would get an infinite procedure, and then would have to show that the 7; were “converging” 
in asuitable sense. (They do converge, but making this precise would require some additional 
effort which our alternate procedure avoids.) 

A strong generalization of this smoothing can be formulated for an arbitrary convex 
function. Recall that a set of points in the plane is said to be convex if the line segment 
joining any two points in the set lies entirely within the set. A function f defined on an 
interval (which may be open, closed or infinite on either end) is said to be convex if the set 


{(c,y) ER’: y > f(z)} 


is convex. We say f is concave if —f is convex. (This terminology was standard at one time, 
but today most calculus textbooks use “concave up” and “concave down” for our “convex” 
and “concave”. Others use the evocative sobriquets “holds water” and “spills water” .) 

A more enlightening way to state the definition might be that f is convex if for any 
t € [0,1] and any x,y in the domain of f, 


tf(z) + (1-4) f(y) = f(te + (1 — thy). 


If f is continuous, it suffices to check this for t = 1/2. Conversely, a convex function is 
automatically continuous except possibly at the endpoints of the interval on which it is 
defined. 

DIAGRAM. 


Theorem 2. If f is a convex function, then the following statements hold: 
1, dp ed then Lo fa) < ee (The slopes of secant lines through the 
graph of f increase with either endpoint.) 


2. If f is differentiable everywhere, then its derivative (that is, the slope of the tangent 
line to the graph of f is an increasing function. ) 


The utility of convexity for proving inequalities comes from two factors. The first factor is 
Jensen’s inequality, which one may regard as a formal statement of the “smoothing principle” 
for convex functions. 


Theorem 3 (Jensen). Let f be a convex function on an interval I and let wi,...,Wn be 
nonnegative real numbers whose sum is 1. Then for all x1,...,% € J, 


wif (21) ae see Wat or) Ze f(winy Sfp eas fe Wabi) 
Proof. An easy induction on n, the case n = 2 being the second definition above. fa] 


The second factor is the ease with which convexity can be checked using calculus, namely 
via the second derivative test. 


Theorem 4. Let f be a twice-differentiable function on an open interval I. Then f is conver 
on I if and only if f"(x) > 0 for alla € I. 


For example, the AM-GM inequality can be proved by noting that f(x) = log is 
concave; its first derivative is 1/2 and its second —1/z?. In fact, one immediately deduces a 
weighted AM-GM inequality; as we will generalize AM-GM again later, we will not belabor 
this point. 

We close this section by pointing out that separable inequalities sometimes concern 
functions which are not necessarily convex. Nonetheless one can prove something! 


Example 5 (USA, 1998). Let ao,..., ay be numbers in the interval (0,7/2) such that 


3 3 


tan(ao — 1/4) + tan(a, — 7/4) +--+ +tan(a, — 7/4) >n-1. 
Prove that tanag tana,---tana, > n"t!. 


Solution. Let x; = tan(a; — 7/4) and y; = tana; = (1+ 2;)/(1 — 2;), so that x; € (—1,1). 
The claim would follow immediately from Jensen’s inequality if only the function f(x) = 
log(1 + x)/(1 — x) were convex on the interval (—1,1), but alas, it isn’t. It’s concave on 
(—1,0] and convex on [0,1). So we have to fall back on the smoothing principle. 

What happens if we try to replace x; and x; by two numbers that have the same sum but 
are closer together? The contribution of x; and x; to the left side of the desired inequality is 


Li+a; 


The replacement in question will increase x;x;, and so will decrease the above quantity 
provided that x; + x; > 0. So all we need to show is that we can carry out the smoothing 
process so that every pair we smooth satisfies this restriction. 

Obviously there is no problem if all of the x; are positive, so we concentrate on the 
possibility of having x; < 0. Fortunately, we can’t have more than one negative «;, since 
Lo +-++ +2, >n-—1 and each 2; is less than 1. (So if two were negative, the sum would 
be at most the sum of the remaining n — 1 terms, which is less than n — 1.) Moreover, if 
xo < 0, we could not have 7 +2; < 0 for 7 =1,...,n, else we would have the contradiction 


Lo t+: +4 < (L—-n)to <n-1. 
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Thus zo +2; > 0 for some j, and we can replace these two by their arithmetic mean. Now all 
of the x; are positive and smoothing (or Jensen) may continue without further restrictions, 
yielding the desired inequality. O 


Problems for Section 1.1 


1. Make up a problem by taking a standard property of convex functions, and specializing 
to a particular function. The less evident it is where your problem came from, the 
better! 


2. Given real numbers 7,...,%,, what is the minimum value of 


fae eee tl neg. |? 


3. (via Titu Andreescu) If f is a convex function and 7, 22,23 lie in its domain, then 
f(@1) + f(®2) + fas) + f 
> = 1 (a*) +f 

1(@)) 


4. (USAMO 1974/1) For a,b,c > 0, prove that a%b’c® > (abc) (e+b+)/3, 


U1, +X. + %3 
cae, 
T+ X3 
A) 


5. (India, 1995) Let x1,...,%, be n positive numbers whose sum is 1. Prove that 


Ly Es, n 


SS Se : 
Vl- 2, Vl—-2,° Yn-1 


6. Let A, B,C be the angles of a triangle. Prove that 


1. sn A+sinB+sinC < 3/3/2: 

2. cos A+ cos B+ cosC < 3/2; 

3. sin A/2sin B/2sinC/2 < 1/8; 

4. cot A+ cot B+ cot C > V3 (i.e. the Brocard angle is at most 7/6). 


(Beware: not all of the requisite functions are convex everywhere!) 
7. (Vietnam, 1998) Let 2,...,2%, (mn > 2) be positive numbers satisfying 


1 1 1 i 
aei0Gs ae gos. 1008 ~ 1998" 
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Prove that 


(Again, beware of nonconvexity.) 


8. Let x1, 22,... be a sequence of positive real numbers. If a, and gz, are the arithmetic 
and geometric means, respectively, of 7,,..., 2%, prove that 
ee ey 
ae (1.1) 
GeO 
NAp — Jn) = (n—- 1)(Gn—1 = Jn-1). (1.2) 


These strong versions of the AM-GM inequality are due to Rado [2, Theorem 60] and 
Popoviciu [3], respectively. (These are just a sample of the many ways the AM-GM 
inequality can be sharpened, as evidenced by [1].) 


1.2 Unsmoothing and noninterior extrema 


A convex function has no interior local maximum. (If it had an interior local maximum at 
x, then the secant line through (a — ¢, f(x — €)) and (x +, f(a + €)) would lie under the 
curve at x, which cannot occur for a convex function.) 

Even better, a function which is linear in a given variable, as the others are held fixed, 
attains no extrema in either direction except at its boundary values. 


Problems for Section 1.2 


1. (IMO 1974/5) Determine all possible values of 


= a i b & Cc 4% d 
hE Ge hae “bee. a co-ed 


where a, b,c,d are arbitrary positive numbers. 


2. (Bulgaria, 1995) Let n > 2 and 0 < 2; <1 for alli = 1,2,...,n. Show that 
n 
(v1 + 2g +--+ +4n) — (4129 + Fo%3 +--+ +4%n%1) < Is : 


and determine when there is equality. 


1.3. Discrete smoothing 


The notions of smoothing and convexity can also be applied to functions only defined on 
integers. 


Example 6. How should n balls be put into k boxes to minimize the number of pairs of balls 
which lie in the same box? 


ny 


‘) over sequences n1,...,n,% Of non- 


Solution. In other words, we want to minimize yo ( 
negative integers adding up to n. 

If nj — n; > 2 for some 7,7, then moving one ball from 7 to 7 decreases the number of 
pairs in the same box by 


()-C3)C)-C2) aac 


Thus we minimize the number of pairs by making sure no two boxes differ by more than one 
ball; one can easily check that the boxes must each contain |n/k| or [n/k] balls. oO 


Problems for Section 1.3 
1. (Germany, 1995) Prove that for all integers k and n with 1 < k < 2n, 
Zt ae 2 woe foe 
+ > 2. : ; 
k-1 k+1 n+2 k 
2. (Arbelos) Let a;,a2,... be a convex sequence of real numbers, which is to say ag_, + 
Gp41 > 2ax for all k > 2. Prove that for all n > 1, 


a, + a3 + +--+ Qan4+1 Aor ar On 
n+1 =, n 


3. (USAMO 1993/5) Let ag, a1,a2,... be a sequence of positive real numbers satisfying 
Q;-14;41 < a? for i = 1,2,3,.... (Such a sequence is said to be log concave.) Show 
that for each n > 1, 


4. (MOP 1997) Given a sequence {z,}°, with 2, > 0 for all n > 0, such that the 
sequence {a"x,, °°, is convex for all a > 0, show that the sequence {log x, }°, is also 
convex. 


5. How should the numbers 1,...,n be arranged in a circle to make the sum of the 
products of pairs of adjacent numbers as large as possible? As small as possible? 


Chapter 2 
Symmetric polynomial inequalities 


This section is a basic guide to polynomial inequalities, which is to say, those inequalities 
which are in (or can be put into) the form P(a1,...,2%,) > 0 with P a symmetric polynomial 
in the real (or sometimes nonnegative) variables 71,...,2n. 


2.1 Introduction to symmetric polynomials 


Many inequalities express some symmetric relationship between a collection of numbers. 
For this reason, it seems worthwhile to brush up on some classical facts about symmetric 
polynomials. 

For arbitrary 71,...,%p, the coefficients c,,..., Cy, of the polynomial 


(f+ 21)---(t+2n) =t? +t? | +--+ + cpt + Cn 


are called the elementary symmetric functions of the x;. (That is, c, is the sum of the 
products of the x; taken k at a time.) Sometimes it proves more convenient to work with 
the symmetric averages 


dj= 7k 


For notational convenience, we put cg = dj = 1 and gq = d, = 0 for k > n. 
Two basic inequalities regarding symmetric functions are the following. (Note that the 
second follows from the first.) 


Theorem 7 (Newton). Jf x1,...,%» are nonnegative, then 
d? > di_idis1 7=1,...,n—-1. 
Theorem 8 (Maclaurin). Jf x1,..., 2% are positive, then 


ed SS 


with equality if and only if 7) =--+: =p. 


These inequalities and many others can be proved using the following trick. 


Theorem 9. Suppose the inequality 


f(di,...,d,) >0 
holds for all real (resp. positive) 11,...,%» for some n >k. Then it also holds for all real 
(resp. positive) 11,...,Un41- 
Proof. Let 


P(t) =(t+a) ++ (t+2n41) = > e : ‘ att 


i=0 
be the monic polynomial with roots —71,...,—%,. Recall that between any two zeros of a 


differentiable function, there lies a zero of its derivative (Rolle’s theorem). Thus the roots 
of P'(t) are all real if the x; are real, and all negative if the x; are positive. Since 


n+1 n 
! ad . n+ 1 n-1 __ n n-1 
PO =Dint1—o( : ) au = (n+ 1) iz ("a 
we have by assumption f(d,,...,d,) > 0. O 


Incidentally, the same trick can also be used to prove certain polynomial identities. 


Problems for Section 2.1 


1. Prove that every symmetric polynomial in 71,...,2, can be (uniquely) expressed as a 
polynomial in the elementary symmetric polynomials. 


2. Prove Newton’s and Maclaurin’s inequalities. 
3. Prove Newton’s identities: if s; = 2 +---+ 2%, then 
CoSk + CrSp_1 +++ + Ce_181 + key = 0. 

(Hint: first consider the case n = k.) 

4. (Hungary) Let f(x) = 2” +ay_,2""-'+-+-+a,2+1 be a polynomial with non-negative 
real coefficients and n real roots. Prove that f(x) > (1+)” for all x > 0. 

5. (Gauss-??) Let P(z) be a polynomial with complex coefficients. Prove that the (com- 
plex) zeroes of P’(z) all lie in the convex hull of the zeroes of P(z). Deduce that if S 


is a convex subset of the complex plane (e.g., the unit disk), and if Rf(d1,...,d,) > 0 
holds for all 7,,...,2%, € S for some n > k, then the same holds for 71,...,%n41 € S. 


6. Prove Descartes’ Rule of Signs: let P(x) be a polynomial with real coefficients written 
as P(x) = S>ax,v*', where all of the ag, are nonzero. Prove that the number of 
positive roots of P(x), counting multiplicities, is equal to the number of sign changes 
(the number of i such that a,,_,a,, < 0) minus a nonnegative even integer. (For 


a 


negative roots, apply the same criterion to P(—2).) 
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2.2 The idiot’s guide to homogeneous inequalities 


Suppose one is given a homogeneous symmetric polynomial P and asked to prove that 
P(a1,...,%n) > 0. How should one proceed? 

Our first step is purely formal, but may be psychologically helpful. We introduce the 
following notation: 


S 5 Q(a1, eae S 5 Q(t): Lites) 


where o runs over all permutations of 1,...,n (for a total of n! terms). For example, if 
n = 3, and we write x,y, z for 71, ©, X3, 


Bs =O Oy hoe" 


sym 
ye eya=xeytyeteatarztyet 27y 
sym 
So xyz = OT 2: 
sym 


Using symmetric sum notation can help prevent errors, particularly when one begins with 
rational functions whose denominators must first be cleared. Of course, it is always a good 
algebra check to make sure that equality continues to hold when it’s supposed to. 

In passing, we note that other types of symmetric sums can be useful when the inequal- 
ities in question do not have complete symmetry, most notably cyclic summation 


S- xy = xy + yz + 272. 

cyclic 
However, it is probably a bad idea to mix, say, cyclic and symmetric sums in the same 
calculation! 


Next, we attempt to “bunch” the terms of P into expressions which are nonnegative for 
a simple reason. For example, 


Vie — xyz) >0 
sym 
by the AM-GM inequality, while 
S(@?y? — 27yz) 20 
sym 


by a slightly jazzed-up but no more sophisticated argument: we have x7y? + x72? > xyz 
again by AM-GM. 

We can formalize what we are doing using the notion of majorization. If s = (s1,..., Sn) 
and t = (t;,...,t,) are two nonincreasing sequences, we say that s majorizes t if s1+---+s, = 
ty +---+t, and s;+---+5; >t, +---+4; for? =1,...,n. 
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Theorem 10 (“Bunching”). Jf s and t are sequences of nonnegative reals such that s 


mayjorizes t, then 


sym sym 


Proof. One first shows that if s majorizes t, then there exist nonnegative constants k,, as 0 
ranges over the permutations of {1,...,7}, whose sum is 1 and such that 


he Seeea.) SCigaata) 
(and conversely). Then apply weighted AM-GM as follows: 
Ss De hank eee = S- hae Aes ey TO) 


kr So(r 7 krSa(r(n 
Se COD) (r(n)) 


Oo 
ty ton 
= Sra ae, 
oO 


IV 


O 
If the indices in the above proof are too bewildering, here’s an example to illustrate what’s 
going on: for s = (5,2,1) and t = (3,3, 2), we have 
(3, 3,2) = (5,2, 1)+ 
and so BLAH. 
Example 11 (USA, 1997). Prove that, for all positive real numbers a, b,c, 
1 n 1 x 1 z i 
e2+8+abe B+A+abe +a3+abe7 abc 
Solution. Clearing denominators and multiplying by 2, we have 
iG + B+ abe)(b? + c? + abe)abe < 2(a° + b° + abc)(b® + 8 + abe)(c3 + a? + abc), 
sym 
which simplifies to 
ys a’bc + 3a°b'c + 40°V?? + BBE < S- orc + 2a°b? + 3a'b*c + 20°? 4+ a’ be, 
sym sym 
and in turn to 
Ss 26°b" = 9a be > 0; 
sym 


which holds by bunching. O 
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In this case we were fortunate that after slogging through the algebra, the resulting 
symmetric polynomial inequality was quite straightforward. Alas, there are cases where 
bunching will not suffice, but for these we have the beautiful inequality of Schur. 

Note the extra equality condition in Schur’s inequality; this is a much stronger result 
than AM-GM, and so cannot follow from a direct AM-GM argument. In general, one can 
avoid false leads by remembering that all of the steps in the proof of a given inequality must 
have equality conditions at least as permissive as those of the desired result! 


Theorem 12 (Schur). Let x,y,z be nonnegative real numbers. Then for any r > 0, 


a'(e—y)(e—2z)+y"(y—z)(y—2)+2"(2-a)(z-y) 20. 
Equality holds if and only if x = y = z, or if two of x,y,z are equal and the third is zero. 


Proof. Since the inequality is symmetric in the three variables, we may assume without loss 
of generality that « > y > z. Then the given inequality may be rewritten as 


(x — y)[x"(@— 2) -—y"(y—2)] + 2" (x — z)(y— 2) 2 9, 
and every term on the left-hand side is clearly nonnegative. O 


Keep an eye out for the trick we just used: creatively rearranging a polynomial into the sum 
of products of obviously nonnegative terms. 

The most commonly used case of Schur’s inequality is r = 1, which, depending on your 
notation, can be written 


3d +dz > 4didy_ or ye — Qx*y + ryz > 0. 
sym 
If Schur is invoked with no mention r, you should assume r = 1. 
Example 13. (Japan, 1997) 
(Japan, 1997) Let a,b,c be positive real numbers, Prove that 


(b+c—a)?  (c+a—b)?  (a+b—c) ee 
(b+c)?+a2 (c+a)?+2 (a+b)? +207~ 5 


Solution. We first simplify slightly, and introduce symmetric sum notation: 
yo 2ab + 2ac < 24 
a az +b? +c2+2be7~ 5- 

Writing s = a? + b? +c’, and clearing denominators, this becomes 


5s? be ab + 10s S- a*bc + 20 S- a>b’c < 6s° + 6s? S- ab + 12s S- a*bc + 480787? 


sym sym sym sym sym 
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which simplifies a bit to 
6s? + 8? S- ab + 2s > abc + 8 ‘> a’b’c? > 10s Ss a*bc + 20 S- a°b2c. 
sym sym sym sym sym 
Now we multiply out the powers of s: 
S- 3a° + 20°b — 2a*h? 4 Bathe + 2a? — 120° We 4b > 0. 
sym 


The trouble with proving this by AM-GM alone is the a2b?c? with a positive coefficient, 
since it is the term with the most evenly distributed exponents. We save face using Schur’s 
inequality (multiplied by 4abc:) 


ys 4a*bc — 8a3b?c + 4a7b?c? > 0, 
sym 


which reduces our claim to 


S- 80° # 20° b= 2a? = a be + 20°? = 40 bo > 0, 


sym 


Fortunately, this is a sum of four expressions which are nonnegative by weighted AM-GM: 


0 < 25 (2a° +0%)/3 — ath? 
sym 
O< S "(4a + b° + c°)/6 — atbe 
sym 
Oe 2 S° (200? + c'a*)/3 — a3 b?c 
sym 
GQ: se 2D S\(2a°b + a’c+ ab’ + ac’) /6 — a°b’c. 
sym 
Equality holds in each case of AM-GM, and in Schur, if and only if a = b=. O 


Problems for Section 2.2 


1. Suppose r is an even integer. Show that Schur’s inequality still holds when x, y, z are 
allowed to be arbitrary real numbers (not necessarily positive). 


2. (Iran, 1996) Prove the following inequality for positive real numbers <, y, z: 


1 1 1 9 
uve tee) (Et Gap Game) 2a 
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3. The author’s solution to the USAMO 1997 problem also uses bunching, but in a subtler 
way. Can you find it? (Hint: try replacing each summand on the left with one that 
factors.) 


4. (MOP 1998) 
5. Prove that for x,y,z > 0, 


x y z 9 
@t+y@+y)  wWtawts) ’ G+ae+y ~Metyte 


2.3 Variations: inhomogeneity and constraints 


One can complicate the picture from the previous section in two ways: one can make the 
polynomials inhomogeneous, or one can add additional constraints. In many cases, one can 
reduce to a homogeneous, unconstrained inequality by creative manipulations or substitu- 
tions; we illustrate this process here. 


Example 14 (IMO 1995/2). Let a,b,c be positive real numbers such that abc = 1. Prove 
that 
1 1 1 


3 
oe ae ns Se a 
a3(b+ c) "; b3(c +a) . Clad bo)" 2 


Solution. We eliminate both the nonhomogeneity and the constraint by instead proving that 


1 1 1 3 
a a 
a3(b +c) ss B3(c +a) “ (a+b) ~ 2(abc)4/3 


This still doesn’t look too appetizing; we’d prefer to have simpler denominators. So we make 
the additional substitution a = 1/7,b = 1/y,c=1/za=a2/y, b= y/z, c= 2/z, in which 
case the inequality becomes 

2 2 2 


>= ; 2.1 
pie eae pay = ght?) ( ) 


Now we may follow the paradigm: multiply out and bunch. We leave the details to the 
reader. (We will revisit this inequality several times later.) a] 


On the other hand, sometimes more complicated maneuvers are required, as in this 
offbeat example. 


Example 15 (Vietnam, 1996). Let a,b,c,d be four nonnegative real numbers satisfying 
the conditions 


2(ab + ac + ad + be + bd + cd) + abc + abd + acd + bed = 16. 
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Prove that 


2 
atb+e+d> 3(ab+ ac + ad + be + bd + cd) 


and determine when equality holds. 


Solution (by Sasha Schwartz). Adopting the notation from the previous section, we want to 
show that 


3d +d3 = 4 = d, > dy. 


Assume on the contrary that we have 3d2 + d3 = 4 but d, < dy. By Schur’s inequality plus 
Theorem 9, we have 


3d? + dz > 4dido. 
Substituting d3 = 4 — 3d2 gives 
3d3 +4 > (4d, + 3)dy > 4dt + 3d), 


which when we collect and factor implies (3d, — 4)(d? — 1) > 0. However, on one hand 
3d, — 4 < 3d, — 4 = —d3 < 0; on the other hand, by Maclaurin’s inequality d? > dy > dj, so 
d, > 1. Thus (3d, — 4)(d? — 1) is negative, a contradiction. As for equality, we see it implies 
(3d, — 4)(d? — 1) = 0 as well as equality in Maclaurin and Schur, so dj =d,=d3=1. O 


Problems for Section 2.3 
1. (IMO 1984/1) Prove that 0 < yz + 22 + xy — 2xyz < 7/27, where x,y and z are 
non-negative real numbers for which x + y+ z= 1. 


2. (Ireland, 1998) Let a,b,c be positive real numbers such that a + 6+ c¢ > abc. Prove 
that a? + b? +c? > abe. (In fact, the right hand side can be improved to V3abc.) 


3. (Bulgaria, 1998) Let a,b,c be positive real numbers such that abc = 1. Prove that 


i! Gs 1 2 1 . 1 at 1 * 1 
Las. ibe. -betbae -— 2a 240 Pte 


2.4 Substitutions, algebraic and trigonometric 


Sometimes a problem can be simplified by making a suitable substition. In particular, this 
technique can often be used to simplify unwieldy constraints. 

One particular substitution occurs frequently in problems of geometric origin. The con- 
dition that the numbers a, b,c are the sides of a triangle is equivalent to the constraints 


at+b>c, b+c>a, ct+ta>b 
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coming from the triangle inequality. If we let x = (b+ c—a)/2,y = (c+a— ))/2,z2 = 
(a+b—c)/2, then the constraints become x, y, z > 0, and the original variables are also easy 
to express: 
a=ytz, b=z4+%4, c=2+4+y. 
A more exotic substitution can be used when the constraint a+ 6+ c = abc is given. Put 


qa=arctana, (@=arctanb, y=arctanc 


then a+ 6+ 7 is a multiple of 7. (If a,b,c are positive, one can also write them as the 
cotangents of three angles summing to 7/2.) 


Problems for Section 2.4 


1. (IMO 1983/6) Let a,b,c be the lengths of the sides of a triangle. Prove that 


a*b(a — b) + Bc(b —c) + Pa(e— a) > 0, 


and determine when equality occurs. 


2. (Asian Pacific, 1996) Let a,b,c be the lengths of the sides of a triangle. Prove that 
VJatb—c+vVb+e—-a+Veta—b< Vat vb4+ Ve. 


3. (MOP, 1999) Let a,b,c be lengths of the the sides of a triangle. Prove that 


a? + 6° + c? — 3abe > 2max{|\a — 6°, |b — c|*, |c — al*}. 


4. (Arbelos) Prove that if a,b,c are the sides of a triangle and 
2(ab? + bc? + ca”) = 7b + 0?c + ea + 3abe, 
then the triangle is equilateral. 


5. (Korea, 1998) For positive real numbers a, b,c with a + 6+ ¢ = abc, show that 


i 1 1 
——— + ——— + 
Vi¢@ V1+RB V1iFe 


and determine when equality occurs. (Try proving this by dehomogenizing and you'll 
appreciate the value of the trig substitution!) 


3 
<-, 
= 9) 
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Chapter 3 


The toolbox 


In principle, just about any inequality can be reduced to the basic principles we have outlined 
so far. This proves to be fairly inefficient in practice, since once spends a lot of time repeating 
the same reduction arguments. More convenient is to invoke as necessary some of the famous 
classical inequalities described in this chapter. 

We only barely scratch the surface here of the known body of inequalities; already [2] 
provides further examples, and [1] more still. 


3.1 Power means 


The power means constitute a simultaneous generalization of the arithmetic and geometric 
means; the basic inequality governing them leads to a raft of new statements, and exposes a 
symmetry in the AM-GM inequality that would not otherwise be evident. 

For any real number r ¥ 0, and any positive reals 71,...,2,, we define the r-th power 
mean of the 2; as 


r ties r \ 1/r 
WEE dee (oe) . 
n 


More generally, if w1,...,W, are positive real numbers adding up to 1, we may define the 
weighted r-th power mean 
T ye ; 


Mi (21,.--;2n) = (wiz] +--+ + Wnt, 


Clearly this quantity is continuous as a function of r (keeping the x; fixed), so it makes sense 
to define M° as 


: T * 1 T T 
lim Mi, = lim (> exp log(wyxa} ++--+ unt 


r—0 


= exp — log(wya) +--+ + wx 
w, log x, +++++ Wy log ary a ai 
FS XD 71 eed EN 
Wy +tt + Wy 
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or none other than the weighted geometric mean of the 2;. 
Theorem 16 (Power mean inequality). [fr > s, then 

Mi COisnsadgte. ) VL its fen Se) 
with equality if and only if 7) =--- =p. 


Proof. Everything will follow from the convexity of the function f(«) = x” for r > 1 (its 
second derivative is r(r — 1)x"~?), but we have to be a bit careful with signs. Also, we’ll 
assume neither r nor s is nonzero, as these cases can be deduced by taking limits. 

First suppose r > s > 0. Then Jensen’s inequality for the convex function f(x) = 27/* 
applied to xj,.... xL* gives 


3 3 


wy tees tnt, > (wy tee + Wnts)! 


and taking the 1/r-th power of both sides yields the desired inequality. 

Now suppose 0 > r > s. Then f(x) = x"/* is concave, so Jensen’s inequality is reversed; 
however, taking 1/r-th powers reverses the inequality again. 

Finally, in the case r > 0 > s, f(x) = 2"/* is again convex, and taking 1/r-th powers 
preserves the inequality. (Or this case can be deduced from the previous ones by comparing 
both power means to the geometric mean.) O 


Several of the power means have specific names. Of course r = 1 yields the arithmetic 
mean, and we defined r = 0 as the geometric mean. The case r = —1 is known as the 
harmonic mean, and the case r = 2 as the quadratic mean or root mean square. 


Problems for Section 3.1 


1. (Russia, 1995) Prove that for x,y > 0, 
x 1 
oe ees 
ge+y? yt+ta~ ay 


2. (Romania, 1996) Let 7,..., 241 be positive real numbers such that 7, ++---+ 2%, = 
Ln41- Prove that 


n n 
ye A/a he = 0S S- Cviengt = Le): 


3. (Poland, 1995) For a fixed integer n > 1 compute the minimum value of the sum 
2 n 
7 x 
Psa et 
2 n 
given that 2,,...,%, are positive numbers subject to the condition 


1 1 
CB 4 
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4. Let a,b,c,d > 0. Prove that 
1 1 4. 16 64 


aS Sg pA, ne 
Ge ae ae eee 


5. Extend the Rado/Popoviciu inequalities to power means by proving that 


Migin.cst HM ee aay < ME aaaxstig- a = ME Gieciy Baa 
Wn 7 Wr =i 
whenever r > k > s. Here the weight vector w’ = (w},...,w/,_,) is given by wi = 
w;j/(wy +++++ Wi). (Hint: the general result can be easily deduced from the cases 


k= 13.) 


6. Prove the following “converse” to the power mean inequality: if r > s > 0, then 


(E) (Ee) 


3.2 Cauchy-Schwarz, Holder and Minkowski inequali- 
ties 
This section consists of three progressively stronger inequalities, beginning with the simple 
but versatile Cauchy-Schwarz inequality. 
Theorem 17 (Cauchy-Schwarz). For any real numbers ay,..., Qn, b1,..-,0n; 
(aj +++ +.a2)(bj +--+ +02) > (arb) H+ + + nbn)’, 

with equality if the two sequences are proportional. 
Proof. The difference between the two sides is 

S \(aibj — ajbi)? 

i<j 
and so is nonnegative, with equality iff ajb; = a,b; for all 2, 7. O 


The “sum of squares” trick used here is an important one; look for other opportunities 
to use it. A clever example of the use of Cauchy-Schwarz is the proposer’s solution of 
Example 14, in which the xyz-form of the desired equation is deduced as follows: start with 
the inequality 


(+4 +=) ((yt2)t (ete) 4+ (a+y)) > (aty4+2) 


which follows from Cauchy-Schwarz, cancel « + y + z from both sides, then apply AM-GM 
to replace x + y+ z on the right side with 3(xyz)'/*. 
A more flexible variant of Cauchy-Schwarz is the following. 
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Theorem 18 (H6lder). Let wi,...,wWy be positive real numbers whose sum is 1. For any 
positive real numbers aj;, 


n m Wi mn 
I] (S-«.] > Ds | aj; 


i=1 \j=l 


Proof. By induction, it suffices to do the case n = 2, in which case we'll write w; = 1/p and 
w2 = 1/q. Also without loss of generality, we may rescale the a;; so that 4 aj; = 1 for 
7 = 1,2. In this case, we need to prove 


m 

1/p 1/q 

Le Sai! Ai 
gal 


On the other hand, by weighted AM-GM, 


ay; a24 1/p 1 
—+,—> Gta 
Pp qd 


and the sum of the left side over j is 1/p + 1/q = 1, so the proof is complete. (The special 
case of weighted AM-GM we just used is sometimes called Young’s inequality.) O 


Cauchy-Schwarz admits a geometric interpretation, as the triangle inequality for vectors 
in n-dimensional Euclidean space: 


qa Ee er? Sh 4 ye te y? > af (ae yi)? hse ag 


One can use this interpretation to prove Cauchy-Schwarz by reducing it to the case in two 
variables, since two nonparallel vectors span a plane. Instead, we take this as a starting 
point for our next generalization of Cauchy-Schwarz (which will be the case r = 2,5 = 1 of 
Minkowski’s inequality). 


Theorem 19 (Minkowski). Let r > s be nonzero real numbers. Then for any positive real 
numbers aj;, 


1/s l/r 


vi mn r/s 
Zao (>: “) 
1 \j=1 


t= 


m n s/T 
ys (>: “) 
j t=1 


| 


Minkowski’s theorem may be interpreted as a comparison between taking the r-th power 
mean of each row of a matrix, then taking the s-th power mean of the results, versus taking 
the s-th power mean of each column, then taking the r-th power mean of the result. If r > s, 
the former result is larger, which should not be surprising since there we only use the smaller 
s-th power mean operation once. 

This interpretation also tells us what Minkowski’s theorem should say in case one of 1, s 
is zero. The result is none other than Hélder’s inequality! 


ZA 


Proof. First suppose r > s > 0. Write Z and R for the left and right sides, respectively, and 


5 < re m 8 
for convenience, write t; = }7j-, aj;. Then 
n n 
ro r/s : r/s—1 
eS SoS at 
i=1 i=1 


I| 
M: 
_——N 
Me: 
Q 
8 
oo 
ae 
oe 
| 
Ns 


j=l i=1 
wi a s/r 1-s/r 

< (Soa) (Sout) <a 
j=1 \i=l i=1 


where the one inequality is a (term-by-term) invocation of Hélder. 

Next suppose r > 0 > s. Then the above proof carries through provided we can prove a 
certain variation of Holder’s inequality with the direction reversed. We have left this to you 
(Problem 3.2.2). 

Finally suppose 0 > r > s. Then replacing a;; by 1/a;; for all 7,7 turns the desired 
inequality into another instance of Minkowski, with r and s replaced by —s and —r. This 
instance follows from what we proved above. Ee] 


Problems for Section 3.2 


1. (Iran, 1998) Let x, y, z be real numbers not less than 1, such that 1/~+1/y+1/z = 2. 
Prove that 


Vl ahyae 2 ale = Lapa yal bale = 1. 


2. Complete the proof of Minkowski’s inequality by proving that if k < 0 and ay,..., dy, 
by,...,5, > 0, then 


akoy—* +--+ akbl-*® > (a, +++ + an)’ (by +++ + bn). 
(Hint: reduce to Hélder.) 


3. Formulate a weighted version of Minkowski’s inequality, with one weight corresponding 
to each a;;. Then show that this apparently stronger result follows from Theorem 19! 


4. (Titu Andreescu) Let P be a polynomial with positive coefficients. Prove that if 


. & > FG) 


holds for x = 1, then it holds for every x > 0. 
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5. Prove that for w,2,y, z > 0, 


wea? + cy? + y82? + 2823 > weary? + a? y?2? + y? 2? w? + 222° y?. 


(This can be done either with Hélder or with weighted AM-GM; try it both ways.) 


6. (China) Let r;, 5;,t;, uj, v; be real numbers not less than 1, for i = 1,2,...,n, and let 


3 


R,S,T,U,V be the respective arithmetic means of the r;, 5;, tj, u;, vj. Prove that 


. 1 SitiUgV; +1 z RSTUV +1 : 
RSTUV —1 


Air isit;ujzv; —1 
i=1 
(Hint: use Hélder and the concavity of f(x) = (2° — 1)/(#° + 1). 


7. (IMO 1992/5) Let S be a finite set of points in three-dimensional space. Let S,, Sy, 5, 
be the orthogonal projections of S onto the yz, zx, xy planes, respectively. Show that 


IS|? < |S2|] Syl] SI. 
(Hint: Use Cauchy-Schwarz to prove the inequality 
2 
(> eb = S- ai. y be, s Chas 
ijk ij jk ki 


Then apply this with each variable set to 0 or 1.) 


3.3. Rearrangement, Chebyshev and “arrange in or- 
der” 


Our next theorem is in fact a triviality that every businessman knows: you make more 
money by selling most of your goods at a high price and a few at a low price than vice versa. 
Nonetheless it can be useful! (In fact, an equivalent form of this theorem was on the 1975 
IMO.) 


Theorem 20 (Rearrangement). Given two increasing sequences 11,...,%n and Y1,---;Yn 
of real numbers, the sum 


n 
iS LiYo(i)s 
i=1 


for o a permutation of {1,...,n}, is maximized when o is the identity permutation and 
minimized when o is the reversing permutation. 
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Proof. For n = 2, the inequality ac + bd > ad + bc is equivalent, after collecting terms and 
factoring, to (a—b)(c—d) > 0, and so holds when a > b and c > d. We leave it to the reader 
to deduce the general case from this by successively swapping pairs of the y;. 

Another way to state this argument involves “partial summation” (which the calculus- 
equipped reader will recognize as analogous to doing integration by parts). Let s; = yo) + 
Seb Yeiny fOr tb Ly cay n, and write 


S > 2iYo(i) = 181 + So (2; => fare 
i=1 G=2 


The desired result follows from this expression and the inequalities 
Bi ee ee <5; ae ae aes 


in which the left equality holds for o equal to the reversing permutation and the right equality 
holds for o equal to the identity permutation. [i] 


One important consequence of rearrangement is Chebyshev’s inequality. 


Theorem 21 (Chebyshev). Let x1,...,¢, and y,...,Yn be two sequences of real numbers, 
at least one of which consists entirely of positive numbers. Assume that x, < +++ < 2%, and 
YW <-+++< Yn. Then 


tite ttn Wt tym 2 Byte + tan 


n n n 
If instead we assume 41 >-+++ > &p and yy <--++ < Yn, the inequality is reversed. 


Proof. Apply rearrangement to %1,%2,...,U% and yj,...,Yn, but repeating each number n 
times. oO 


The great power of Chebyshev’s inequality is its ability to split a sum of complicated 
terms into two simpler sums. We illustrate this ability with yet another solution to IMO 
1995/5. Recall that we need to prove 


2 2 2 
a Yy z ane ae 


=f a 
Ye Z£+X %“U+Yy 2 


Without loss of generality, we may assume x < y < z, in which case 1/(y+z) < 1/(z+2) < 
1/(a + y). Thus we may apply Chebyshev to deduce 


x y? Zz rt+yt+2 1 1 1 
+ + —— > ——_—. + + . 
Uae Raa Py 3 Ue Zt ey 


By the Power Mean inequality, 


ae a ee (tee) 
3 7 3 


5 ( 1 At at ) 3 
ONS eae eS ay oat se 
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and these three inequalities constitute the proof. 

The rearrangement inequality, Chebyshev’s inequality, and Schur’s inequality are all 
general examples of the “arrange in order” principle: when the roles of several variables are 
symmetric, it may be profitable to desymmetrize by assuming (without loss of generality) 
that they are sorted in a particular order by size. 


Problems for Section 3.3 


1. Deduce Schur’s inequality from the rearrangement inequality. 
2. For a,b,c > 0, prove that a®b’ce > a®bc*. 


3. (IMO 1971/1) Prove that the following assertion is true for n = 3 and n = 5 and false 


for every other natural number n > 2: if a,,...,@, are arbitrary real numbers, then 
n 
ys [[@ az) > 0 
i=1 ji 


4. (Proposed for 1999 USAMO) Let x, y, z be real numbers greater than 1. Prove that 


24 24 24 
£ FAY 2 ad +220 52 +2xry = ( LYAYZH EE 


% ryz) 


3.4 Bernoulli’s inequality 


The following quaint-looking inequality occasionally comes in handy. 


Theorem 22 (Bernoulli). For r > 1 and a > —-1 (orr an even integer and x any real), 
(l+2)">1+4+ ar. 


Proof. The function f(x) = (1+2)" has second derivative r(r—1)(1+2)"~? and so is convex. 
The claim is simply the fact that this function lies above its tangent line at 7 = 0. O 


Problems for Section 3.4 


1. (USA, 1992) Let a = (m™*! + n"*!)/(m™ +n") for m,n positive integers. Prove 
that a" +a" > m™ +n". (The problem came with the hint to consider the ratio 
(a% — N‘)/(a— N) for real a > 0 and integer N > 1. On the other hand, you can 
prove the claim for real m,n > 1 using Bernoulli.) 
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Chapter 4 


Calculus 


To some extent, I regard this section, as should you, as analogous to sex education in school— 
it doesn’t condone or encourage you to use calculus on Olympiad inequalities, but rather 
seeks to ensure that if you insist on using calculus, that you do so properly. 

Having made that disclaimer, let me turn around and praise calculus as a wonderful 
discovery that immeasurably improves our understanding of real-valued functions. If you 
haven’t encountered calculus yet in school, this section will be a taste of what awaits you—but 
no more than that; our treatment is far too compressed to give a comprehensive exposition. 
After all, isn’t that what textbooks are for? 

Finally, let me advise the reader who thinks he/she knows calculus already not to breeze 
too this section too quickly. Read the text and make sure you can write down the proofs 
requested in the exercises. 


4.1 Limits, continuity, and derivatives 


The definition of limit attempts to formalize the idea of evaluating a function at a point 
where it might not be defined, by taking values at points “infinitely close” to the given 
point. Capturing this idea in precise mathematical language turned out to be a tricky 
business which remained unresolved until long after calculus had proven its utility in the 
hands of Newton and Leibniz; the definition we use today was given by Weierstrass. 

Let f be a function defined on an open interval, except possibly at a single point t. We 
say the limit of f at t exists and equals L if for each positive real €, there exists a positive 
real 6 (depending on ¢, of course) such that 


O0<|e-t1<6 = |f(a)-L<e 


We notate this lim,_,, f(x) = L. If f is also defined at t and f(t) = L, we say f is continuous 
at t. 

Most common functions (polynomials, sine, cosine, exponential, logarithm) are contin- 
uous for all real numbers (the logarithm only for positive reals), and those which are not 
(rational functions, tangent) are continuous because they go to infinity at certain points, so 
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the limits in question do not exist. The first example of an “interesting” limit occurs in the 
definition of the derivative. 

Again, let f be a function defined on an open interval and ¢ a point in that interval; this 
time we require that f(t) is defined as well. If the limit 


exists, we call that the derivative of f at t and notate it f’(t). We also say that f is 
differentiable at t (the process of taking the derivative is called differentiation). 

For example, if f(x) = x’, then for x # t, (f(x) — f(t))/(c-—t) =z +t, and so the limit 
exists and f’(t) = 2t. More generally, you will show in the exercises that for f(x) = 2x”, 
f'(t) = nt"-'. On the other hand, for other functions, e.g. f(x) = sina, the difference 
quotient cannot be expressed in closed form, so certain inequalities must be established in 
order to calculate the derivative (as will also take place in the exercises). 

The derivative can be geometrically interpreted as the slope of the tangent line to the 
graph of f at the point (t, f(t)). This is because the tangent line to a curve can be regarded 
as the limit of secant lines, and the quantity (f(a +t) — f())/t is precisely the slope of the 
secant line through (x, f(x)) and (7 +t, f(~+t)). (The first half of this sentence is entirely 
unrigorous, but it can be rehabilitated.) 

It is easy to see that a differentiable function must be continuous, but the converse is not 
true; the function f(x) = |x| (absolute value) is continuous but not differentiable at x = 0. 

An important property of continuous functions, though one we will not have direct need 
for here, is the intermediate value theorem. This theorem says the values of a continuous 
function cannot “jump”, as the tangent function does near 7/2. 


Theorem 23. Suppose the function f is continuous on the closed interval |a,b]. Then for 
any c between f(a) and f(b), there exists x € [a,b] such that f(x) =. 


Proof. Any proof of this theorem tends to be a bit unsatisfying, because it ultimately boils 
down to one’s definition of the real numbers. For example, one consequence of the standard 
definition is that every set of real numbers which is bounded above has a least upper bound. 
In particular, if f(a) < cand f(b) > c, then the set of x € [a,b] such that f(x) < chas a least 
upper bound y. By continuity, f(x) < c on the other hand, if f(x) > c¢, then f(a — t) > 0 
for all t less than some positive €, again by continuity, in which case x — € is an upper bound 
smaller than x, a contradiction. Hence f(x) =. O 


Another important property of continuous functions is the “extreme value theorem”. 


Theorem 24. A continuous function on a closed interval has a global maximum and mini- 
mum. 


Proof. O 
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This statement is of course false for an open or infinite interval; the function may go to 
infinity at one end, or may approach an extreme value without achieving it. (In technical 
terms, a closed interval is compact while an open interval is not.) 


Problems for Section 4.1 


10. 


11, 


12. 


. Prove that f(«) = x is continuous. 


. Prove that the product of two continuous functions is continuous, and that the recip- 


rocal of a continuous function is continuous at all points where the original function is 
nonzero. Deduce that all polynomials and rational functions are continuous. 


. (Product rule) Prove that (fg)’ = fg'+ f’g and find a similar formula for (f/g)’. (No, 


it’s not f’/g — f/g'. Try again.) 


. (Chain rule) If h(x) = f(g(x)), prove that h’(x) = f'(g(x))g'(x). 
. Show that the derivative of x” is nxz”~! for n € Z. 


. Prove that sinz < a < tanz for 0 < x < 7/2. (Hint: use a geometric interpretation, 


and remember that x represents an angle in radians!) Conclude that lim, ,9 sin v/a = 
1. 


. Show that the derivative of sin x is cosa and that of cos is (—sinx). While you’re at 


it, compute the derivatives of the other trigonometric functions. 


. Show that an increasing function on a closed interval satisfying the intermediate value 


theorem must be continuous. (Of course, this can fail if the function is not increasing!) 
In particular, the functions c* (where c > 0 is a constant) and log are continuous. 


. For c > 0 a constant, the function f(x) = (c* — 1)/z is continuous for x 4 0 by the 


previous exercise. Prove that its limit at 0 exists. (Hint: if c > 1, show that f is 
increasing for « 4 0; it suffices to prove this for rational x by continuity.) 


Prove that the derivative of c” equals kc* for some constant k. (Use the previous 
exercise.) Also show (using the chain rule) that & is proportional to the logarithm of 
c. In fact, the base e of the natural logarithms is defined by the property that k = 1 
when c=e. 


Use the chain rule and the previous exercise to prove that the derivative of log x is 1/. 
(Namely, take the derivative of e!°8* = z.) 


(Generalized product rule) Let f(y, z) be a function of two variables, and let g(x) = 
f (a,x). Prove that g'(x) can be written as the sum of the derivative of f as a function 
of y alone (treating z as a constant function) and the derivative of f as a function of z 
alone, both evaluated at y = z = x. For example, the derivative of x” is x* logx + x”. 
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4.2 Extrema and the first derivative 


The derivative can be used to detect local extrema. A point t is a local maximum (resp. 
minimum) for a function f if f(t) > f(x) (resp. f(t) < f(x)) for all x in some open interval 
containing ft. 


Theorem 25. [ft is a local extremum for f and f is differentiable at t, then f'(t) = 0. 


Corollary 26 (Rolle). If f is differentiable on the interval [a, b| and f(a) = f(b) = 0, then 
there exists x € [a,b] such that f'(x) =0. 


So for example, to find the extrema of a continuous function on a closed interval, it 
suffices to evaluate it at 


e all points where the derivative vanishes, 
e all points where the derivative is not defined, and 
e the endpoints of the interval, 


since we know the function has global minima and maxima, and each of these must occur at 
one of the aforementioned points. If the interval is open or infinite at either end, one must 
also check the limiting behavior of the function there. 

A special case of what we have just said is independently useful: if a function is positive 
at the left end of an interval and has nonnegative derivative on the interval, it is positive on 
the entire interval. 


4.3 Convexity and the second derivative 


As noted earlier, a twice differentiable function is convex if and only if its second derivative 
is nonnegative. 


4.4 More than one variable 


Warning! The remainder of this chapter is somewhat rougher going than what came before, 
in part because we need to start using the language and ideas of linear algebra. Rest assured 
that none of the following material is referenced anywhere else in the notes. 

We have a pretty good understanding now of the relationship between extremization 
and the derivative, for functions in a single variable. However, most inequalities in nature 
deal with functions in more than one variable, so it behooves us to extend the formalism of 
calculus to this setting. Note that whatever we allow the domain of a function to be, the 
range of our “functions” will always be the real numbers. (We have no need to develop the 
whole of multivariable calculus when all of our functions arise from extremization questions!) 
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The formalism becomes easier to set up in the language of linear algebra. If f is a 
function from a vector space to R defined in a neighborhood of (i.e. a ball around) a point 
Z, then we say the limit of f at # exists and equals L if for every « > 0, there exists 6 > 0 
such that 


0< || <5 — |f(#+t)-L| <e. 


(The double bars mean length in the Euclidean sense, but any reasonable measure of the 
length of a vector will give an equivalent criterion; for example, measuring a vector by the 
maximum absolute value of its components, or by the sum of the absolute values of its 
components.) We say f is continuous at 7 if limp, f(@+t) = f(z). If 7 is any vector and # 
is in the domain of f, we say the directional derivative of f along # in the direction y exists 
and equals f;(Z) if 


+19) -f@, 


fy(#) = lim 5 
If f is written as a function of variables x1,...,%,, we call the directional derivative along 


the 7-th standard basis vector the partial derivative of f with respect to 7 and denote it by 
ae In other words, the partial derivative is the derivative of f as a function of «2; along, 
regarding the other variables as constants. 

TOTAL DERIVATIVE 

Caveat! Since the derivative is not a “function” in our restricted sense (it has takes 
values in a vector space, not R) we cannot take a “second derivative” —yet. 

ASSUMING the derivative exists, it can be computed by taking partial derivatives along 
a basis. 


4.5 Convexity in several variables 


A function f defined on a convex subset of a vector space is said to be convex if for all 7,7 
in the domain and ¢ € [0, 1], 


tf(z) + (1 —t) f(y) = fe + (1 — t)y/). 


Equivalently, f is convex if its restriction to any line is convex. Of course, we say f is concave 
if —f is convex. 

The analogue of the second derivative test for convexity is the Hessian criterion. A 
symmetric matrix M (that is, one with M,; = M,; for all i, 7) is said to be positive definite if 
Mz-x > 0 for all nonzero vectors , or equivalently, if its eigenvalues are all real and positive. 
(The first condition implies the second because all eigenvalues of a symmetric matrix are 
real. The second implies the first because if M/ has positive eigenvalues, then it has a square 
root N which is also symmetric, and MZ. 7# = (NZ) - (NZ) > 0.) 
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Theorem 27 (Hessian test). A twice differentiable function f(21,...,%n) is convex in a 
region if and only if the Hessian matrix 


0? 
Hy =~—— 
? Ox ,OX ; 


is positive definite everywhere in the region. 


Note that the Hessian is symmetric because of the symmetry of mixed partials, so this 
statement makes sense. 


Proof. The function f is convex if and only if its restriction to each line is convex, and the 
second derivative along a line through # in the direction of 7 is (up to a scale factor) just 
Hy-y evaluated at x. So f is convex if and only if Hy-y > 0 for all nonzero y, that is, if 
His positive definite. O 


The bad news about this criterion is that determining whether a matrix is positive 
definite is not a priori an easy task: one cannot check MZ. > 0 for every vector, so it 
seems one must compute all of the eigenvalues of M, which can be quite a headache. The 
good news is that there is a very nice criterion for positive definiteness of a symmetric matrix, 
due to Sylvester, that saves a lot of work. 


Theorem 28 (Sylvester’s criterion). Ann xn symmetric matrix of real numbers is pos- 
itive definite if and only if the determinant of the upper left k x k submatrix is positive for 
eae ence 


Proof. By the Mz. definition, the upper left k x k submatrix of a positive definite matrix 
is positive definite, and by the eigenvalue definition, a positive definite matrix has positive 
determinant. Hence Sylvester’s criterion is indeed necessary for positive definiteness. 

We show the criterion is also sufficient by induction on n. BLAH. O 


Problems for Section 4.5 
1. (IMO 1968/2) Prove that for all real numbers 21, 29, y1, Yo, 21, 22 With 71,72 > 0 and 


1Y1 > 22, Loo > 2, the inequality 


8 1 1 
(v1 + %2)(y1 + yo) — (i te)? ~ tiyr— 27 Loyo — 23 


is satisfied, and determine when equality holds. (Yes, you really can apply the material 
of this section to the IMO! Verify convexity of the appropriate function using the 
Hessian and Sylvester’s criterion.) 
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4.6 Constrained extrema and Lagrange multipliers 


In the multivariable realm, a new phenomenon emerges that we did not have to consider in 
the one-dimensional case: sometimes we are asked to prove an inequality in the case where 
the variables satisfy some constraint. 


The Lagrange multiplier criterion for an interior local extremum of the function f(a1,...,2n) 
under the constraint g(1,...,2%n) = ¢ is the existence of A such that 
Of Og 
Vises ire ee La eee ese 
Day | 1 im) Das | 1; ’ “) 


Putting these conditions together with the constraint on g, one may be able to solve and 
thus put restrictions on the locations of the extrema. (Notice that the duality of constrained 
optimization shows up in the symmetry between f and g in the criterion.) 

It is even more critical here than in the one-variable case that the Lagrange multiplier 
condition is a necessary one only for an interior extremum. Unless one can prove that the 
given function is convex, and thus that an interior extremum must be a global one, one must 
also check all boundary situations, which is far from easy to do when (as often happens) 
these extend to infinity in some direction. 

For a simple example, let f(x,y, z) = ax +by +cz with a, b,c constants, not all zero, and 
consider the constraint g(x,y, z) = 1, where g(x,y,z) = 2? + y? + 2”. Then the Lagrange 
multiplier condition is that 


G=2A5,0 = DNie = 2X2. 


The only points satisfying this condition plus the original constraint are 
1 

a 

Va? + 6? + c? 


and these are indeed the minimum and maximum for f under the constraint, as you may 
verify geometrically. 


(a, b,c), 
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Chapter 5 


Coda 


5.1 Quick reference 
Here’s a handy reference guide to the techniques we’ve introduced. 


e Arithmetic-geometric-harmonic means 
e Arrange in order 

e Bernoulli 

e Bunching 

e Cauchy-Schwarz 

e Chebyshev 

e Convexity 

e Derivative test 

e Duality for constrained optimization 
e Equality conditions 

e Factoring 

e Geometric interpretations 

e Hessian test 

e Holder 


e Jensen 
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e Lagrange multipliers 

e Maclaurin 

e Minkowski 

e Newton 

e Power means 

e Rearrangement 

e Reduction of the number of variables (Theorem 9) 
e Schur 

e Smoothing 

e Substitution (algebraic or trigonometric) 
e Sum of squares 

e Symmetric sums 


e Unsmoothing (boundary extrema) 


5.2 Additional problems 


Here is an additional collection of problems covering the entire range of techniques we have 
introduced, and one or two that you’ll have to discover for yourselves! 


Problems for Section 5.2 


1. Let 2, y,z > 0 with cyz = 1. Prove that r+ yt+z<a?+y?4 2”. 


2. The real numbers 21,%2,...,2%p belong to the interval [—1,1] and the sum of their 
cubes is zero. Prove that their sum does not exceed n/3. 


3. (IMO 1972/2) Let 2,..., x5 be positive reals such that 


2 2 
(Ti41 — Vi43%i45) (Tipo — TizsVirs) < 0 
for? =1,...,5, where p45 = 2», for all n. Prove that 7; =-::= 2s. 


4. (USAMO 1979/3) Let 2, y, z > 0 with +y+z=1. Prove that 
cae eae 1 
ey ae + bayz 2 7. 
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5. (Taiwan, 1995) Let P(x) = 1+ayr+---+a,-12""'+2” be a polynomial with complex 


coefficients. Suppose the roots of P(x) are a1, Q2,...,Q, with 
Jay] > 1, a2] >1,...,Ja;| > 1 
and 
lagal < 1, legys| < Tyne, al ST. 
Prove that 


j 
[[ lei < Vlaol? + Tas +--+ Taal 


t=1 


(Hint: look at the coefficients of P(x) P(x), the latter being 1+a@jr+- --+a@,-72" '+2".) 


6. Prove that, for any real numbers 2, y, z, 


& 


(a) 
(b) 


3(2? —2 +1)? —yt+1)(22 — 241) > (yz)? + zyz +1. 


Prove that any polynomial P(«) such that P(x) > 0 for all real x can be written 
as the sum of the squares of two polynomials. 


Prove that the polynomial 
aa? sa ar 1) aye = 1) GP =e) = 2) yy?) 


is everywhere nonnegative, but cannot be written as the sum of squares of any 
number of polynomials. (One of Hilbert’s problems, solved by Artin and Schreier, 
was to prove that such a polynomial can always be written as the sum of squares 
of rational functions. ) 
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